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Abstract 

Background: Concurrent validity and intra-rater reliability using a customized Android phone application to 
measure cervical-spine range-of-motion (ROM) has not been previously validated against a gold-standard 
three-dimensional motion analysis (SDMA) system. 

Findings: Twenty-one healthy individuals (age:31 ±9.1 years, male:ll) participated, with 16 re-examined for 
intra-rater reliability 1-7 days later. An Android phone was fixed on a helmet, which was then securely fastened on 
the participant's head. Cervical-spine ROM in flexion, extension, lateral flexion and rotation were performed in sitting 
with concurrent measurements obtained from both a SDMA system and the phone. 

The phone demonstrated moderate to excellent (ICC = 0.53-0.98, Spearman p = 0.52-0.98) concurrent validity for 
ROM measurements in cervical flexion, extension, lateral-flexion and rotation. However, cervical rotation 
demonstrated both proportional and fixed bias. Excellent intra-rater reliability was demonstrated for cervical flexion, 
extension and lateral flexion (ICC = 0.82-0.90), but poor for right- and left-rotation (ICC = 0.05-0.33) using the phone. 
Possible reasons for the outcome are that flexion, extension and lateral-flexion measurements are detected by 
gravity-dependent accelerometers while rotation measurements are detected by the magnetometer which can be 
adversely affected by surrounding magnetic fields. 

Conclusion: The results of this study demonstrate that the tested Android phone application is valid and reliable to 
measure ROM of the cervical-spine in flexion, extension and lateral-flexion but not in rotation likely due to magnetic 
interference. The clinical implication of this study is that therapists should be mindful of the plane of measurement 
when using the Android phone to measure ROM of the cervical-spine. 
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Findings 

Introduction 

Cervical range-of-motion (ROM) assessment forms an 
integral part of physiotherapy evaluation in people with 
neck-pain by quantify^ing an important physical impair- 
ment [1] and providing potentially useful diagnostic data 
[2]. In this regard, the cervical range-of-motion device 
(CROM) [3,4] and single inclinometer are considered 
the most appropriate clinical measurement instruments. 
However, the CROM is relatively expensive (US$395) 
and cumbersome, and the inclinometer although more 
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affordable, has been reported to have inconsistent and 
inferior validity for cervical lateral-flexion and rotation 
measurements [5,6]. 

Advances in smart phone sensor technology have re- 
sulted in inexpensive ROM measurement tools with clinical 
and research potential. Specifically, the smart phone uses 
an embedded-accelerometer and a magnetometer to detect 
motion using gravity and the earths magnetic field respect- 
ively. To our knowledge, only one published study [7] has 
examined the validity and reliability of the smartphone to 
measure cervical ROM. Although that study reported some 
promising findings, it did possess limitations including: a) 
the criterion reference used (i.e. CROM) did not allow for 
concurrent testing of the phone, and lacked the sensitivity 
and precision of a multi-camera three-dimensional motion 
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analysis (3DMA) system, which may have negatively 
influenced the mostly moderate validity findings; b) no 
reported effort was made to ensure that movement was 
well-controlled and along the intended axis of head 
movement; and c) the examiner was not blinded to the 
results obtained from the phone and the CROM de- 
vice, hence error due to reporting bias cannot be ruled 
out. This may potentially overestimate the validity re- 
sults. Therefore the purpose of this study was to inves- 
tigate the concurrent validity and test-retest reliability 
of an Android smart phone to assess cervical ROM. Our 
study extends prior research by (i) verifying the validity of 
the smart phone by concurrently assessing with a 3DMA 
system, the gold-standard for capturing motion analysis 
[8], (ii) adding a spirit-level type indicator to the phone 
application to ensure a pure axis of movement [9] and (iii) 
blinding the examiner to the results. We hypothesize that 
the phone will be valid and reliable. 

Methods 

Subjects 

Twenty-one healthy individuals (age:31 ±9.1 years, height: 
172.7 ± 8.9 cm, weight:68.5 ± 11.2 kg, male:ll) with no 
reported neck-pain participated. Sixteen participants 
returned 1-7 days later to assess intra-rater reliability. 
All participants provided informed consent as outlined 
by the institution s Human Research Ethics Committee and 
all procedures were conducted according to the Declaration 
of Helsinki. 

Procedures 

Three reflective markers were located on the following 
anatomical landmarks: anterior to the tragus bilaterally 
and on the glabella (Figure 1) for 3DMA analysis. Markers 



were tracked using VICON Nexus VI. 7.1 and a 9-camera 
VICON MX motion analysis system (VICON, UK). The 
angle of the head in the three planes was referenced to 
the laboratory axis, and normalized to the starting neu- 
tral position, and was deemed our benchmark reference 
kinematic data. 

All measures were performed with the subject seated 
in the same high-back padded chair. To ensure minimal 
contribution from the thoracic spine, the participant was 
securely strapped across the shoulders to the chair using 
an inelastic belt (Figure 1: Mulligan Mobilization Belt). An 
Android 4.0 phone (Samsung Galaxy S3, GT-I9300T) was 
mounted on a helmet (Figure 1), and the helmet was fas- 
tened securely on the patients head using an internal ad- 
justable head strap fixed within the helmet. This phone 
contains a LSM330DLC inertial monitoring unit combin- 
ing tri-axial accelerometer and gyroscope sensors, and an 
AKM8975 tri-axial magnetometer. 

The following cervical-spine ROM limit measurements 
were obtained in the same order in all subjects: (i) 
flexion, (ii)extension, (iii) right-lateral-flexion, (iv)left-lat- 
eral-flexion, (v) right- rotation and (vi) left-rotation. The 
flexion/extension, lateral flexion/extension and rotation 
axes were measured using the pitch, roll and azimuth 
angles respectively. Given that cervical rotation values 
are based on the magnetometer within the phone and 
the outcome may be influenced by the surrounding 
magnetic fields, a magnetic yoke was placed around the 
subjects neck in an attempt to address this problem. 
This replicates the use of the CROM, which also uses 
magnetic fields to determine angles and requires the use 
of a magnetic yoke. 

The patient was instructed to perform each test actively, 
with manual guidance provided by the examiner to ensure 
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that the movement was along the pure axis of alignment if 
necessary. Specifically, the examiner determined the end 
of ROM when a firm resistance was felt. No pain was re- 
ported by any subject during the procedure. Three con- 
secutive trials using concurrent measurements from the 
VICON and the phone were obtained for each move- 
ment. The mean value of the three measurements for 
the first testing day was used to calculate validity, and an 
inter-day comparison of these mean values was performed 
to determine intra-rater reliability. 

All subjects were assessed by the same examiner (JQ) 
who has 12 years of clinical musculoskeletal physiotherapy 
experience. Noteworthy, because it is difficult for the 
examiner to visually detect when the subject deviates 
away from the pure movement plane, one of the advan- 
tages of this phone application over previous applica- 
tions [7] was that it included a visual representation of 
a circular spirit device (Figures 2A and 2B). This en- 
abled the examiner to guide subjects along the desired 
plane of movement using the real-time visual feedback. 
This program sampled data at lOOHz using a custom 
program designed by co-author RC using MIT App 
Inventor. The standard angle data parsed from the 
angle calculation performed within the Smartphones 
operating system was used, indicating that our results 
are likely to be applicable regardless of the software 
program used. Two separate examiners were assigned to 
each device (phone and 3DMA), hence they were blinded 
to the results of the other device. 



Statistical Analysis 
Validity 

Validity was determined from Spearman's correlation 
and intra-class correlation coefficient (ICC) in combination 
with assessment of systematic bias. Bland and Altman plots 
were constructed to determine the 95% limits of agreement 
(LoA) between the 3DMA and phone measures [10,11]. 
Ordinary least products (OLP) regression, which accounts 
for error in both devices, was used to determine fixed and 
proportional biases [12]. All calculations were performed as 
described previously [13]. 

Reliability 

Intra-rater reliability was determined using intra-class 
coefficients (ICC [3,3]), and OLP regression to quantify the 
relationship between sequential measurements for both 
instruments. ICC was calculated in a 2-way analysis of 
variance based on absolute agreement. Point estimates of 
the ICC values >0.75 were considered excellent, 0.4-0.75 
modest or <0.4 poor [14]. To estimate measurement error, 
standard error of measurement (SEM), LOA, and minimal 
detectable change (MDC) were calculated. Statistical ana- 
lyses were completed using PASW software V21. 

Results 

Validity 

The phone demonstrated excellent concurrent validity 
for flexion, extension, and lateral flexion ROM based on 
Spearmans p-values >0.84 and ICC values >0.90, but 
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Figure 2 Comparison of lateral flexion assessment techniques. (A) Right lateral flexion in a single axis. Note that the red dot is aligned with 
the horizontal line. (B) Right lateral flexion with some cervical flexion. Note that the red dot is not aligned with the horizontal line. 
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Table 1 Validity of the phone compared to 3DMA using 3 repetitions of each cervical movement (n = 21) 




Phone 
(iviean ± bUj 


3DIVIA 
(iviean ± bUj 


ICC 

(3/3) 


Spearman's p* 


95% CI 


Average 
systematic 
bias (CI) 


Width of 
y5% LOA 


% Error^ 


Prop 
Bias 


Fixed 
bias 


Flexion 


52.0 ±8.7 


49.9 ± 8.8 


0.98 


0.99 


0.30 to 0.996 


None 


2.3 


2 


N 


N 


Extension 


79.3 ± 8.0 


80.4 ± 9.9 


0.92 


0.83 


0.80 to 0.97 


None 


9.6 


6 


N 


N 


Riglit Lateral Flexion^ 


45.0 ±7.3 


43.0 ± 7.0 


0.96 


0.93 


0.71 to 0.99 


None 


4.6 


5 


N 


N 


Left Lateral Flexion 


48.8 ± 8.8 


47.8 ± 8.0 


0.95 


0.92 


0.89 to 0.98 


None 


7.1 


7 


N 


N 


Right Rotation 


57.1 ±9.7 


70.9 ± 7.2 


0.53 


0.81 


-0.13 to 0.85 


-33.7 + 0.31 


9.6 


8 


Y 


Y 


Left Rotation 


65.3 ±15.1 


71.4 ±5.8 


0.53 


0.52 


-0.60 to 0.80 


-71.2 + 0.95 


18.6 


14 


Y 


Y 



SD = standard deviation; 3DMA = three dimensional motion analysis; ICC = Intra-class coefficients; CI = confidence Interval; LoA = limits of agreement; Prop 

Bias = proportional bias; N = no; Y = yes. 

*AII correlations were p < 0.001 except Left Rotation (p = 0.02). 

"^Based on n = 20 as markers on one subject were missing. 

Vo Error = O.S^WIdth of 95% LOA/[(Meanphone + Meanvicon)/2]. 

^Proportional and fixed bias were determined from ordinary least products analysis. 



only modest validity results for left-rotation (ICC =0.53, 
Spearman's p =0.52) and right-rotation (ICC =0.53) (Table 1). 
Furthermore, for right- and left-rotation, both proportional 
and fixed biases were observed (see Table 1 and Additional 
file 1: Appendix A for the OLP and LOA plots). 

Intra-rater reliability 

Intra-rater reliability is presented in Tables 2 and 3. Excellent 
intra-rater reliability results were observed for both phone 
and 3DMA measurements in cervical flexion, extension 
and right- and left-lateral flexion (ICC = 0.82-0.90), but re- 
sults were poor for the phone in right- and left-rotation 
(ICC = 0.05-0.33), whilst the 3DMA showed modest 
intra-rater reliability (ICC = 0.64-0.77). Percentage error 
values for the phone ranged from 7-40% and 6-9% for 
3DMA (Tables 2 and 3). LOA plots are presented in 
the Additional file 1: Appendix B & C. 

Discussion 

This study demonstrates that an Android phone can be 
a valid and reliable tool to measure ROM of cervical 
flexion, extension and lateral-flexion but not cervical 
rotation, consistent with previous results [7]. Cervical 



Table 2 Intra-rater reliability of the phone (n = 16) 





Phone D1 
(Mean ± SD) 


Phone D2 
(Mean ± SD) 


ICC (3,3) 


95% CI 


Flexion 


51.3 + 7.9 


54.9 ± 7.5 


0.86 


0.38-0.96 


Extension^ 


79.0 ± 7.6 


80.8 ± 7.03 


0.82 


0.49-0.94 


Right Lateral Flexion 


43.5 ± 6.7 


44.9 ± 7.0 


0.90 


0.73-0.97 


Left Lateral Flexion 


49.1 ±8.8 


51.2 ±7.4 


0.85 


0.57-0.95 


Right Rotation 


50.0 ±17.1 


70.5 ± 22.7 


0.33 


-0.34-0.73 


Left Rotation 


64.3 ±16.3 


69.8 ±15.6 


0.05 


-1.7-0.67 



rotation results cannot be seen as valid and reliable as, 
although the rotation measurements from the phone 
showed moderate validity values (ICC = 0.53), the reliabil- 
ity results were poor. Possible reasons for these results are 
that, in the position tested, both sagittal and frontal mea- 
surements rely on the gravity-dependent accelerometers 
within the phone but the movements in the transverse 
plane are detected by the magnetometer, which can be 
adversely affected by any surrounding magnetic fields. 
This includes equipment such as computers, speakers 
and some automatic doors, which were all present in 
the laboratory and may have caused the error observed 
in this axis. We attempted to overcome this issue using 
the magnet supplied with the CROM, however our re- 
sults were still invalid in this axis. This is clinically 
relevant because strong magnetic fields are likely to be 
present in many clinical settings and thus rotation ROM as- 
sessment using devices that rely on data from the magnet- 
ometer cannot be recommended (i.e. rotation in sitting). 

Potential reasons for the greater ICC values in the present 
study compared to previous work [7] are the concurrent 
measurements and the addition of the spirit level indicator 
to improve the accuracy of measurement. The latter is 



Sys Width of % Error^ Prop Fixed SEM MDC LOA 2SD (mean 



bias 


95% LoA 




bias^ 


bias^ 






diff ±2.1*SDdiff) 


N 


9.1 


9 


N 


N 


3.1 


9.2 


-12.84 to 5.48 


N 


11.8 


7 


N 


N 


5.0 


11.9 


-13.67 to 10.3 


N 


8.3 


9 


N 


N 


2.8 


8.3 


-9.73 to 6.95 


N 


11.8 


12 


N 


N 


4.1 


12.2 


-14.20 to 10.16 


N 


48.2 


40 


N 


N 


16.4 


48.7 


-70.79 to 29.81 


N 


46.8 


35 


N 


N 


15.8 


46.9 


-52.38 to 41.36 



SD = standard deviation; ICC = Intra-class coefficients; CI = confidence interval; Sys Bias = systematic bias; LoA = limits of agreement; Prop Bias = proportional bias; 

N = no; Y = yes; SEM = standard error of measurement; MDC = minimal detectable change; diff= difference. 

^Based on n = 15 as one subject's thoracic spine was not well stabilized. 

Vo Error = O.S^Width of 95% LOA/[(Meanphone + Meanvicon)/2]. 

^Proportional and fixed bias were determined from ordinary least products analysis. 
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Table 3 Reliability of the 3DMA (n = 16) 



Phone D1 Phone D2 ICC (33) 95% CI Sys Width of % Error^ Prop Fixed SEM MDC LOA 2SD (mean 
(IVlean±SD) (Mean±SD) bias 95% LoA bias^ bias^ diff ±2.1*SDdiff) 



Flexion 


48.9 ± 7.7 


51.9H 


b6.9 


0.88 


0.54-0.96 


N 


8.7 


9 


N 


N 


3.0 


8.91 


-14.77 to 8.90 


Extension^ 


79.1 ±9.9 


81.6 d 


b9.2 


0.88 


0.67-0.96 


N 


10.0 


6 


N 


N 


34 


10.1 


-12.69 to 7.56 


Right Lateral Flexion 


41.7 ±6.7 


42.9 d 


b6.9 


0.94 


0.82-0.98 


N 


6.8 


8 


N 


N 


2.3 


6.83 


-8.01 to 5.51 


Left Lateral Flexion 


46.7 ± 7.6 


47.1 d 


b6.6 


0.92 


0.78-0.97 


N 


8.0 


9 


N 


N 


2.8 


8.32 


-8.57 to 7.89 


Right Rotation 


68.8 ±5.1 


72.7 d 


b5.9 


0.64 


-0.010-0.85 


N 


104 


7 


N 


N 


3.6 


10.69 


-14.45 to 6.81 


Left Rotation 


70.2 ± 6.7 


734 d 


b6.7 


0.77 


0.32-0.92 


N 


11.2 


8 


N 


N 


3.8 


11.29 


-14.35 to 8.03 



SD = standard deviation; ICC = intra-class coefficients; CI = confidence interval; Sys Bias = systematic bias; LoA = limits of agreement; Prop Bias = proportional bias; 

N = no; Y = yes; SEM = standard error of measurement; MDC = minimal detectable change; diff = difference. 

^Based on n = 15 as one subject's thoracic spine could not be effectively stabilized using the experimental technique utilized. 

Vo Error = O.S^Width of 95% LOA/[(Meanphone + Meanvicon)/2]. 

^Proportional and fixed bias were determined from ordinary least products analysis. 



especially important because the cervical-spine is a multi- 
joint structure and susceptible to coupled movements. Fur- 
thermore, we minimized measurement errors by standard 
fixation of the phone on a helmet, compared to the phone 
being held by hand on the participants head in the previ- 
ous study [7]. This also implies that the phone ought to be 
mounted on a helmet when it is being used in the clinical 
setting, and may be considered a limitation of this study. 
Furthermore, we found that when measuring cervical 
extension, the combined weight of the helmet and the 
phone tended to cause the helmet to slip. The examiner 
overcame this problem by providing adequate support to 
ensure that the helmet was firmly fixed on the head during 
the movement. 

This study has several other limitations, (i) We did not 
assess inter-rater reliability and this may potentially limit 
the applicability of our findings in clinical settings between 
observers, (ii) We did not include a rigorous warm-up re- 
gime to ensure consistent inter-day readiness to perform 
the movements. While this is unlikely to affect the con- 
current validity data (i.e. an increase in range of motion 
intra-session would be detected by both devices if they are 
comparable), it may have negatively affected our reliability 
results, (iii) As a preliminary step to assess the validity and 
reliability of the Android phone application, all participants 
were healthy, therefore the results need to be replicated 
in populations of interest, such as those with neck-pain, 
(iv) The reliability data of the 3DMA system for the 
rotation axis was not particularly good, and it is not 
possible to determine whether this is due to intra-day 
subject variation (which would provide justification for 
the poor phone reliability results) or equipment-related 
measurement error (which would not have affected the 
phone reliability values). 

In summary, this study aimed to establish the validity 
and intra- rater reliability of an Android phone applica- 
tion to measure cervical-spine ROM and found that cer- 
vical flexion, extension and lateral-flexion measurements 
are both valid and reliable in sitting and may be used in 



the clinical setting. In contrast, cervical rotation measure- 
ments in sitting are neither valid nor reliable likely due to 
magnetic field interference. We suggest further study to 
determine whether the phone is valid to measure cervical- 
rotation in supine, which would use the accelerometer 
derived angles and is therefore likely to provide more 
consistent results. 
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Additional file 1: Appendix A. Validity assessment using OLP plots for 
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Altman Plots. 
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